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Mock weak lensing analysis of simulated galaxy clusters: 
bias and scatter in mass and concentration 
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ABSTRACT 

We quantify the bias and scatter in galaxy cluster masses M200 and concentrations 
c derived from an idealised mock weak gravitational lensing (WL) survey, and their 
effect on the cluster mass-concentration relation. For this, we simulate WL distortions 
on a population of background galaxies due to a large (« 3000) sample of galaxy 
cluster haloes extracted from the Millennium Simulation at z ~ 0.2. This study takes 
into account the influence of shape noise, cluster substructure and asphericity as well 
as correlated large-scale structure, but not uncorrelated large-scale structure along 
the line of sight and observational effects (e.g., the source redshift distribution and 
measurement, and measurement of galaxy cllipticities). We find a small, but non- 
ncgligblc, negative median bias in both mass and concentration at a level of ~ 5%, 
the exact value depending both on cluster mass and radial survey range. Both the 
mass and concentration derived from WL show considerable scatter about their true 
values. This scatter has, even for the highest mass clusters of M200 > 10 14 ' 8 M Q , a 
level of ~ 30% and ~ 20% for concentration and mass respectively and increases 
strongly with decreasing cluster mass. For a typical survey analysing 30 galaxies per 
arcmin 2 over a radial range from 30" to 15' from the cluster centre, the derived M200-C 
relation has a slope and normalisation too low compared to the underlying true (3D) 
relation by ~ 40% and ~ 15% respectively. The scatter and bias in mass are shown 
to reflect a departure at large radii of the true WL shear/matter distribution of the 
simulated clusters from the NFW profile adopted in modelling the mock observations. 
Orientation of the triaxial cluster haloes dominates the concentration scatter (except 
at low masses, where galaxy shape noise becomes dominant), while the bias in c is 
mostly due to substructure within the virial radius. 



Key words: gravitational lcnsing:weak — galaxies: clusters: general — galaxies: 
groups: general — cosmology: theory 



1 INTRODUCTION 

There are several aspects of galaxy clusters that make them 
sensitive tracers of cosmic evolution, and thus potentially 
powerful tools for measuring a number of fu ndamental cos- 
mological parameters (for rec ent reviews see IVoitll2005l and 
lAUen. Evrard fc Mantj|201ll ). First, in currently- favoured 
hierarchical models for structure formation where small ob- 
jects collapse first and merge together to form progressively 
larger ones, clusters are the most recent objects to have 
formed, since they are the largest bound and virialized ob- 
jects in the Universe at present. Consequently, the abun- 
dance of clusters as a function of mass and redshift is sen- 
sitive to cosmological parameters that have an influence on 
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the rate of growth of structure (such as as, S7m, and the 
nature of dark energy). Second, the matter content (specifi- 
cally the baryon to total mass ratio) of clusters is expected 
to reflect that of the universe as a whole (i.e., w Q.f > /Q. m ; 
IWhite et al.1ll993h , since the potential wells of clusters are 
incredibly deep and it is difficult to conceive of sources that 
are energetic enough to remove baryons from them. Finally, 
the shape of the total matter density profile (which is dom- 
inated by dark matter), sp ecifically how con centrated it is 
as a function of mass (e.g., lBuote et alj|2007h . is also sensi- 
tive to the underlying cosmological parameters through the 
growth rate of structure, since the concentration is thought 
to be determin ed by the background density at epoch of 
formation (e.g.. iNavarro. Frenk fc White 199y). All of these 
cluster-based cosmological tests rely on there being accu- 
rate estimates of cluster mass and also concentration (in the 
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case of the latter test, which is our main focus in the present 
study), at least in a statistical sense. This therefore requires 
that the bias and scatter inherent in cluster mass and con- 
centration estimators be carefully quantified and accounted 
for. 

Weak gravitational lensing (hereafter WL) provides 
one of the most promising methods for deriving the 
masses and concentrations of large samples of galaxy 
clusters and thus for measuring cosmological parame- 
ters such as erg and the evolution of the dark energy 
to (potentially) high accuracy. For high-mass clusters, 
masse s and concentrations can be obtained individually 
(e.g., iDahlel 120061; iBroadhurst et al.l |20oj; iMahdayi et all 



2008 



Radovich et al 



sl; lOkabe fc Umetsul |200Sl: iMedezinski et all 1201 



2008 



Corless. King fc Clowe 
whereas less massive systems can be studied by 
stacking the len sing pro files of many cluste rs (e.g. 



Johnston et al.l l2007t iMandelbaum fc Seliakl l2007t 



Sheldon et aiT 120091 : IRozo. Wu fc Schmidt 



the near future, the Dark Ener 



iThe Dark Energy Survey Collaboration! 120051 ) is expected 
to make observations of ~ 20, 000 clusters with masses in 
excess of 2 x 1O 14 M0. Note that unlike most other methods 
that are used to measure the mass and concentration 
of clusters, like hydrostatic eq uilibrium analyses of the 
hot intracluster medium (e.g., IVikhlinin et al. I 120091 and 
references therein) or vi rial equilibrium ana lyses of orbiting 
satellite galaxies (e.g., iBecker et al.l I2007T ). WL analyses 
do not require any assumptions about the dynamical state 
of the cluster. As we will show, however, this does not 
guarantee that the WL-de rived masses and concen tra- 
tions are unbiased (se e also IBecker fc Kravtsovl l201ll and 
lOguri fc Hamanj|20lJ ). 

In the present study we aim to quantify the bias and 
scatter in galaxy cluster masses, M200, and concentrations, 
c, derived from a mock WL survey and their effect on the de- 
rived cluster mass-concentration relation. Mock WL obser- 
vations based on numerical simulations and analytic models 
of clusters offer the unique possibility of comparing the ob- 
served and true parameters for the same clusters to find the 
extent to which observational biases contribute to the dis- 
crepancies. There have been a number of such studies in the 
past, focussing on various aspects such as cluster aspheric- 
ity and substructure (e.g. , King. Schneider fc Springell200ll ; 



20111 ). In 

Survey (DES, 



IClowe. De Lucia fc Kin3l2004 I Corless fc King! |2007l). cor 



related (e.g.. iMetzler et all Il999l ; iMetzler. White fc Lokenl 
l200ll ; iKing fc Corlessl 120071 ') and uncorre lated larg e -scale 
structure along t he line of sigh t (e.g ., IHoekstra 120031 ; 
Dodelsonl 12004 iHoekstra et all 120111 ). In particular, 



Corless fc King (|2007f ) found from an analysis of lensed ana- 



lytic clusters that for projections along a line of sight close to 
the major axis concentrations and mass can be overpredicted 
by factors of up to « 2 and 1.5 respectively. In a comparison 
between X-ray and WL derived masses of galaxy clusters, 
iMeneghetti et all i|2010h used high-resolution re-simulations 
of three clusters to find deviations of up to 50% between 
true and WL masses. 

While these studies indicated the extent to which var- 
ious complications can potentially bias the WL-derived 
masses and concentrations, it is equally important to know 
how likely they will do so. Investigating this requires large, 
high resolution cosmological simulations containing a large 



enough number of realistically modelled clusters to allow 
statistically robust and meaningful conclusions to be drawn 
abo ut those in the real Univers e. In a rece nt study aiming at 
this, Becker fc Kravtsovl (|201ll ) — see also lOguri fc Hamanal 
12011 — used a large sample of ~ 10 4 haloes and derived a 
typical scatter in the reconstructed masses of ~ 25 — 30% 
and also a systematic bias of ~ —5 to —10%. In the con- 
text of the mass-concentration relationship however, which 
is our focus here, we also need to quantify the corresponding 
scatter and bias in concentration, as well as any potential 
variation of it with cluster mass. 

With this aim in mind, we produce synthetic WL ob- 
servations based on a large, unbiased sample of galaxy clus- 
ters from the Millennium Simulation, each of which is 'ob- 
served' in a number of different, randomly selected projec- 
tions. These mock observations are then analysed in approx- 
imately the same way as observational data and the mass 
and concentration obtained are compared to the true values 
to quantify the scatter and bias in the reconstructed param- 
eters and the mass-concentration relation. Beyond quanti- 
fying the scatter and bias, we also aim to identify physical 
explanations for them from a detailed analysis of the simu- 
lated clusters. This may help to miniminse these effects in 
future surveys, for example through appropriate selection of 
clusters or limiting the analysis to a particular radial range. 

The simulations we use contain only dissipationless 
dark matter. While including a realistic baryonic compo- 
nent would be desirable, the computational cost of running 
hydrodynamic simulations of large volumes (a requirement 
for mock WL surveys) at high resolution is currently pro- 
hibitively large. While baryonic physics is expected to sig- 
nificantly impact on the strong lens ing properties of mas- 
sive clust ers (e.g., Mead et aTT 2010T ). it has recently been 
shown bv lSemboloni et alj ( 201 if ) that its effect on WL mea- 
surements is limited to haloes with a mass below 1O 14 M . 
Analysing exclusively clusters above this mass threshold, we 
therefore do not expect the inclusion of a realistic baryonic 
component to significantly modify our results or conclusions. 

This paper is structured as follows: In §2 we review 
the basic WL formalism and then describe our simulations 
and subsequent data analysis in §3. We quantify the mass- 
concentration relation and the spread in the reconstructed 
parameters in §4, followed by a detailed analysis of the phys- 
ical principles responsible for scatter and bias in §5. We dis- 
cuss and summarise our findings in §6. For consistency with 
the Millennium Simulation, a flat cosmology with Hubble 
parameter h — Ho/(100 kms~ 1 Mpc~ 1 ) = 0.73, dark en- 
ergy density parameter Qa = 0.75 (dark energy equation 
of state parameter w = —1), and matter density parameter 
Qm = 0.25 is used throughout this paper. 



2 WEAK LENSING FORMALISM 

Gravitational lensing describes the deflection of light by 
massive objects. It is sensitive only to the projected mass 
density E of the lens, with higher E generally corresponding 
to larger distortions, for centrally condensed objects. Unlike 
strong lensing, which occurs in cluster centres and leads to 
multiple imag es of background ga laxies which may be highly 
distorted (eg. ISoucail et al.l 119871 ) . weak gravitational lens- 
ing can be employed to study the outer (r > 100 kpc), less 
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dense cluster regions. Due to its weak nature, background 
galaxies are only slightly distorted, an effect that must be 
studied statistically. Assuming that the light from galaxies 
can be approximated by elliptical isophotes, one can quan- 
tify their shape by the complex quantity ellipticity (e), its 
modulus related to the ratio between the minor and major 
axis r = b/a by 



1 + r 



and with a phase of twice the position angle of the ellipse's 
major axis. In the WL regime, the observed and source el- 
lipticities of a background galaxy, in the following denoted 
by e and e 3 respectively, are related by 

e= £s+g (1) 

where the complex quantity g is the "reduced shear", with 
its complex conjugate denoted by g* . The reduced shear is 
then related to the (complex) shear, 7 (the tidal gravita- 
tional field), and the convergence, n, by 



7 



1 - AC 



C2) 



Equation (flj implies that in the ideal case of a perfectly 
circular background galaxy with r = 1 and e a — 0, the lensed 
ellipticity e = g. 

In the above, k is proportional to the projected mass 
density of the lens, S: 

« = , (3) 



where 



D s 



" 4ttG D d D ds (4) 

is the "critical density" and D a , Dd and Dd a are the angular 
diameter distances between observer - source, observer - 
lens and lens - source respectively. In this notation, the WL 
regime is where E << E cr , i.e. k << 1. 

The lensing deflection potential, ip, is related to 7 
and k by a set of partial differential equations (e.g. 
iBartelmann fc Schneid"ei]|200ll ): 

«(*) = 5(^,11 + ^,22) (5) 

7i(0) = ^(^,11-^,22) 

72(0) = ^,12 = 1p,21 , 

where 

7(0) = 7i + ^72 

and the indices following the comma denote partial deriva- 
tives with respect to the components of the position vector 
9. 

A secondary effect is a slight modification in the ob- 
served number density of background galaxies, niensed, due 
to magnification changing the apparent fluxes of galaxies, as 
well as changing the apparent area of sky in which they are 
observed. The net effect depends on the slope of the num- 
ber counts of the galaxies (/?), wi th the lensed an d unlensed 
number counts being related by (|Canizareslll982f ): 



_ 0-1 
ensed M ^unlensed 



(6) 



where the magnification [1 is given by 

^ = T\ Til • ( 7 ) 

(1 -k) 2 - | 7 | 2 

Since /3 w 0.5 for the faint distant galaxies typically used 
in WL analyses, this results in "num ber count depiction" 
l|Broadhurst. Taylor fc Peacock! Il995h . with the observed 
background galaxy density decreasing with decreasing dis- 
tance from the cluster centre in the WL regime. 



3 MOCK WEAK LENSING OBSERVATIONS 
AND ANALYSIS 

3.1 Simulated galaxy clusters 

We extract simulated gal axy clusters from th e Millennium 
Simulation (hereafter MS; ISpringel et al1l2005h . a large cos- 
mological N-body simulation that follows 2160 3 dark mat- 
ter particles from z = 127 to 2 = in a periodic box of 
500 /i -1 Mpc on a side. The cosmology adopted for the MS, 
which we also adopt for our analysis, is a flat ACDM model 
with h — 0.73, Qm = 0.25, and a power spectrum normali- 
sation on a scale of 8/i _1 Mpc of as = 0.9 (i.e., the rms linear 
mass fluctuation in a sphere of radius 8/1 -1 Mpc extrapo- 
lated to present-day). These parameters are consistent with 
the latest measurements of temperature and polarization 
anisotropies in the cosmic microwave background (CMB) 
with the Wilkinson Microwave Anisotropy Probe (WMAP; 
iKomatsu et alj[201ll ). although the value of as adopted for 
the MS is larger than the maximum likelihood CMB value 
by « 2a. The larger value of as means that the MS will have 
more massive clusters than a universe with the WMAP 7- 
year cosmology. However, as we are interested in the lensing 
signal of individual clusters (specifically how well WL can 
recover their mass and concentration) and not their abun- 
dances, this discrepancy will not affect the validity of our 
results. 

From the snapshot at z ~ 0.2, a typical redshift of ob- 
served WL clusters, we select all of the simulated clusters 
with masses M200 > 1O 14 M0 for analysis. Note that M200 
is defined as the mass within a radius (r2oo) that encloses 
a mean density equal to 200 times the critical density of 
the universe — in our adopted cosmology, this density is 
p CIit = 1.76 • lO n M /Mpc 3 at our chosen redshift. From 
here on, we will refer to these masses obtained directly from 
the MS particle distribution without any profile fitting as 
'true' mass, denoted by Mmui- A large sample of 2678 sim- 
ulated cluster haloes satisfies this criterion, which will allow 
us to robustly quantify the mean trends and scatter in the 
derived mass-concentration relationship. 

We extract all of the dark matter particles within a 
10/i _1 Mpc (comoving) box, centered on the most bound 
particle, for producing WL maps of each cluster. For refer- 
ence, r2oo is typically ~ 2 Mpc for the most massive clusters 
in our sample (and smaller for lower mass clusters). Thus, 
our analysis includes only the local environment around the 
clusters. This was deliberate, so that we can isolate the ef- 
fects of cluster triaxiality, substructure and connecting fil- 
aments (i.e., "correlated" signals) from uncorrelated line- 
of-sight structures at much larger distances. While these 
correlated structures can in general extend beyond a dis- 
tance of 5 h^ 1 from the cluster centre, we verify in ap- 
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pe ndix IBTI fFig. iBil that, in agreement with the findings 
by IBecker fc Kravtsovl (|201ll ). our results are robust to in- 
creasing the line-of-sight integration length by a factor of five 
to 50 /i -1 comoving Mpc. Much longer integration lengths, 
which would capture uncorrelated large scale structure more 
fully, would in principle be desirable for the purpose of im- 
proving the prediction accuracy, but require the use of ray- 
tracing algorithms which i s beyond the scope of this work. 
In a complementary study. IHoekstra et al.l (|201ll ) have used 
ray-tracing of the MS to examine the effect of such uncorre- 
lated structures on the derived masses and concentrations of 
analytic clusters and found that it contributes to scatter, but 
not bias in mass and concentration. We discuss the results 
of these authors in the context of our findings in Section [6] 



3.2 Generating weak lensing maps 

For each cluster we produce surface mass density maps by 
projecting the 10 h" 1 Mpc box along one side and interpolat- 
ing to a regular grid of 2 000 2 pixels using a triangular shaped 
clouds (TSC) algorithm (|Hocknev fc Eastwood! 19881 ). It was 
checked that other interpolation algorithms, such as cloud- 
in-cells or smoothed particle hydrodynamics (SPH) inter- 
polation, did not yield significantly different results. At the 
adopted resolution, 1 pixel length corresponds to 5/i _1 kpc, 
equivalent to the gravitational softening length of the MS, 
which makes it the highest sensible resolution. 

To further boost our statistics, and explore the role of 
viewing angle for individual objects, we repeated this pro- 
cedure for each simulated cluster five times, each time se- 
lecting a random orientation and thus produce five different 
maps for each cluster. In the DES, observations will be made 
of ~ 20, 000 clusters with masses in excess of 2 x 10 14 M Q . 
The total number of projections we produce is compara- 
ble to this survey. For the most massive clusters (with 
M 200 > 1O 14 ' 8 M ) in our sample, we have elected to boost 
our statistics even further by producing maps correspond- 
ing to 50 different random projections. The logic behind 
this is that i) such massive systems are the most commonly- 
targetted in present WL observational studies (and therefore 
are the systems for which we can presently make compar- 
isons between theory and observations); and ii) very high 
mass (~ 10 15 Af e ) clusters are rare even in a 500/i 1 Mpc 
volume. 

Convergence (ft) maps are then computed according to 
cqn. (|3j with E cr as above, and the shear maps formed ac- 
cording to equations <(Sj and ([2]). To solve these equations, 
we ad opt the same FFT method as lClowe. De Lucia fc Kina 
l|2004h . computing 



7 



k{ - fe|. 2fcifc 2 . 



k-^ ~\~ k^ 



k-^ ~\~~ k^ 



(8) 



where 7 and k are Fourier transforms of 7 and ft, and k are 
the appropriate wave vectors. As an example, Fig. [T] shows 
three projections of one high-mass cluster with the corre- 
sponding shear fields as tick marks. It is apparent that dif- 
ferent projections of the same cluster can look very different 
and lead to different shear signals. 

With shear maps for all the projections generated, an 
array of background galaxies, extending by default to a pro- 
jected distance of r out = 15' from the cluster centre, was 



then simulated for each individual projection. This limit 
in projected distance excludes potential numerical artifacts 
near the edges of the shear field; i t also matches the typica l 
field-of- view of observa tions (e.g. IClowe fc Schneider! 1200 J ; 
see also lHoekstrdl2003h . where for the most massive clus- 
ters the shear signal is detected out to roughly this radius. 
Although galaxies used in real weak lensing surveys have a 
range of redshifts, we consider only the simplified case of a 
uniform source redshift of z = l.cQ. This is a value typical for 
observational s tudies such as CF HTLS (|llbert et al.l l2006h 
and COSMOS |llbert et al.ll2009l ) and has also been used in 
other the oretical work concerning the accuracy of weak lens- 
ing (e.g., Clowe. De Lucia fc King 2004 ; Oguri fc Hamanal 



l201ll ; IGruen et al.ll201ll ; IBecker fc Kravtsovll201ll '). In real 
survey s the dispersion in sou rce redshifts and its finite sam- 
pling (|Hoekstra et al.l l201ll ) has to be considered as an 
additional error source. We note that for this choice of 
lens and source redshift, the critical surface mass density 
E cr = 3.33 ■ 10 15 M Q /Mpc 2 . 

To exclude the strong lensing regime in the cluster cen- 
tre, we excised the central region within r = r[ n , with a 
default inner limit radius r- m = 30 arcsec, a value typical of 
the e xtent of strongly len sed arcs in observational studies 
(e.g.. Irlennawi et al.ll2008r ). We consider the effect of chang- 
ing the values of both ri n and r out in appendix IB3I while 
the exact amount of bias and scatter de pends somewhat on 
the e xact choice of ri n and r out (see also IBecker fc Kravtsovl 
120111) our overall conclusions are unaffected by their exact 
choice. 

The background galaxy ellipticities e s were drawn ran- 
domly from a Gaussian distrib ution w i th sta ndard deviation 
o = 0.2 per component as in iGeigerl (|l998l ) ; note that this 
choice of a is also similar to that used by IHoekstra et alj 
(2011). The effect of increasing the value of a is shown in 
appendix |B2] it does not affect our results significantly. The 
positions of galaxies were allocated randomly, with average 
unlensed density from which shapes can be measured accu- 
rately n = 30 arcmin -2 , and accounting for Poisson noise. 
This is comparable to background densities achievable with 
curre nt ground-b ased pointed observations of galaxy clusters 
fe.g., |Pahlell2006f ) and similar to what will be achieved with 
upcoming large surveys such as the DES3 and that from the 
Large Synoptic Survey Telescope (LSST)0. 

The distortion of these simulated background galaxies 
by the cluster-induced shear field was then computed ac- 
cording to eqn. ([1} to yield the lensed background galaxy 
ellipticities e. To account for number count depletion as de- 
scribed in Section [2] the lensed source density was adjusted 



1 Note that at the lens redshift of 2 ~ 0.2, 1' corresponds to 
~ 0.2 Mpc for our adopted cosmology. 

2 Even though the expected source density for the DES, of ~ 10 
arcmin -2 , is somewhat lower than our adopted fiducal back- 
ground density, we have experimented with lowering our source 
density from 30 to 10 arcmin" 2 and find that it results in only a 
modest increase in the scatter in the derived masses and concen- 
trations. Our conclusions in Section 5, that it is halo triaxiality 
and substructure, rather than low signal-to-noise, that dominate 
the error in the reconstructed masses and concentrations are ro- 
bust to lowering the background source density to this level. 

3 http://www.lsst.org/lsst/ 
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Figure 1. Three projections of a high-mass cluster with M200 = 4- lO 15 Af0. The red tick marks represent the reduced shear field induced 
by these projections in the WL regime (shown for K < 0.1), with the tick length proportional to the shear modulus and orientation 
showing the shear angle. The scaling is logarithmic, darker regions have higher density. The circles enclose the region of 15' around the 
cluster centre which was analysed in this study. Different projections of the same cluster can give rise to very different shear signals. 



locally according to equations ((6| and (0. At this stage we 
have the final synthetic catalogues of lensed galaxies. 



by an NFW profile, parameterised by M200 and c, u sing a 
standard least-squares method (see lPress et al.l ll992b with 
metric 



3.3 Fitting cluster profiles 

We derive the best-fit mass, M200, and concentra- 
tion, c, by fitting proj e cted N FW mass distributions 
jNavarro. Frenk fc White! 1 19951; [ Navarro. Frenk fc White! 



' ffNFw(fi, M, C)Y 



(12) 



ll996l ; lNavarro, Frenk fc Whitdll997t ) to our mock WL data. 
The NFW profile, which has been shown to reproduce the 
3D spherically-averaged mass density profiles of dark matter 
haloes spanning a wide range of masses, is described by the 
two parameter form: 



where 



p(r) 



psj Pcrit 



(r/r a ){l + r/r s y 



200 



3 ln(l + c) - c/(l + c) 



(9) 



(10) 



and the concentration c = r2oo/r s . Thus, the density dis- 
tribution is determined once the concentration (or equiva- 
lently the scale radius, r s ) and M200 (or equivalently T2oo) 
are specified. 

Analytic expressions for the NFW profile integrated 
along th e line of sight , Snf w, an d the resulting shea r 7 are 
given by iBartelmannl 1 19961 ) and I Wright fc Brainerdl l|200Ch 
respectively, from which the WL distortion can be calculated 
as shown above. We point out that the analytic expressions 
found in these studies were derived by integrating an NFW 
profile extending to infinity along the line of sight, rather 
than to some distance characteristic of the cluster size (e.g., 
T20o). We discuss the effect of this model assumption further 
in Section \5. 2, 2 1 

We derive the best-fit NFW parameters by first calcu- 
lating the tangential ellipticity et of all background galaxies 
with cluster-centric distance n n < r < r out , defined by 

e t = -Re{ee" 2 ^} (11) 

which are then fit by the tangential reduced shear generated 



Equation (|12l) implies that we take into account, equally 
weighted, the tangential ellipticity of each individual galaxy 
when fitting. Other commonly used methods employed to 
analyse wea k lensing signals are m aximum-likelihood tech- 
niques (e.g., ICorless fc Kmgll2008l ) and fitting a ID shear 
profile derive d from binning up the individu al galaxy ellip- 
ticities (e.g., IClowe. De Lucia fc King! |2004| ). We have ex- 
plicitly verified that our particular choice of fitting method 
has no significant influence on our results (see also appendix 
IB3[) . The best-fit concentration and mass are then taken as 
the reconstructed cluster parameters. From here on, we will 
refer to the values obtained in this way as cwl and JV/wl 
respectively. 

Our aim is to compare WL reconstructions to the real 
cluster parameters to see how projection effects and the ap- 
plication of a simplified mass model for the halo modify the 
deduced values. For this comparison it is also necessary to 
obtain a 'true' concentration — a model-independent ref- 
erence value for the mass is already provided by Mmm — 
which we do by fitting an NFW profile to the 3D cluster 
data. In the following, we will denote the parameters M200 
and c derived in this way by C3D and M3D. 

Our 3D fittin g procedure is similar to that described by 
iNeto et all (|2007l ) for haloes in the Millennium simulation: 
the cluster particles are grouped into 32 radial bins from 
l°gio( r / r 20o) = -2.5 to 0.0, equally spaced in log 10 (r/r 2 oo). 
For each bin, the average density pi is then computed and 
the NFW parameters obtained by performing a least squares 
fit of log 10 pi to log 10 pNFW, taking into account only bins 
at a radius log 10 (ri/r2oo) > —1.63. This criterion ensures 
that the central cluster region, where the density is affected 
by smoothing, is ex cluded from our fi t. In this, our method 
differs slightly from lNeto et al.l |2007l ). who adopt an inner 
cut-off radius of log 10 (ri/r v i r ) = —1.3. The reason behind 
this is that unlike their study, we only look at massive haloes 
with M200 > 10 14 Mq with a larger r2oo • It has been shown 
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13.5 14,0 14.5 15.0 15,5 

Figure 2. Mass-concentration plot obtained from our mock weak 
lensing analysis showing five projections of each cluster (grey 
points). The black triangles show the median concentrations for 
each bin with the black dash-dot line giving the corresponding 
best-fit power-law as described in the text. The blue circles and 
solid line give the corresponding 3D NFW medians and best-fit 
power-law respectively. Filled symbols represent median values 
used for constructing the power-law, open ones were discarded. 
The errorbars (dotted for WL, solid for 3D) indicate binsize in 
x-direction, whereas in y-direction the 25 th and 75 th percentiles 
are shown. The wcak-lcnsing derived concentrations are system- 
atically too low compared to those from our reference 3D fit, with 
the discrepancy increasing for lower mass systems. 



4 DERIVED MASS-CONCENTRATION 
RELATION 

In Fig. [2] we show the mass-concentration relationship de- 
rived from our mock WL analysis of MS clusters. Each of the 
grey dots represents a single projection of one cluster. The 
solid triangles represent the median WL-derived concentra- 
tion in 16 equally-spaced bins of log lo (MwL/Af0) from 13.6 
to 15.2 with bin width Alog 10 (M W L/M Q ) = 0.1. The solid 
circles represent the median true (3D) concentration in the 
corresponding true mass bins . 

There is considerable scatter in the mass-concentration 
relation derived from the mock WL observations, but the 
trend towards higher concentrations for lower masses is ev- 
ident. A power-law of form 

a(M WL /lO 14 /r 1 M )' 3 (13) 

was fit to the WL-derived median mass-concentration distri- 
bution, assuming an error in each bin proportional to 1/ \fnl 
where rii is the number of cluster projections per mass bin. 
Only mass bins with Mwl > 14.2 were included in the fit, 
since below this mass range the results are affected by our 
arbitrary cut-off at Mmhi = 10 14 M©. The best-fit parame- 
ters obtained from this procedure are awL = (4.25 ± 0.04) 
and /JwL = (—0.10 ±0.01); we show this relation as the solid 
black line in Fig. [2] For comparison, we also show the best-fit 
powerlaw to the true (3D) mass-concentration relation (solid 
blue line in Fig. [2} , determined in the same way as for the 
WL data, but excluding systems with M^u > 1O 15 M0 due 
to the very small number of systems in this range. The pa- 
rameters of this best-fit 3D powerlaw are 03/3 = (5.02L0.08) 
and /?3_d = (— 0.16L0.02). Both the normalisation and slope 
of the WL inferred powerlaw are too low compared to their 
3D counterparts. 



by iGao et all (|2008T ) that the best-fit concentration in the 
NFW profile depends somewhat on the exact choice of the 
inner cut-off radius, with lower values generally leading to 
higher concentrations, which we have confirmed for our clus- 
ter fits. It should therefore be borne in mind that the bias 
we derive is strictly applicable only with respect to this par- 
ticular fitting range. In the future, it may be advisable to 
adopt more accurate fitting function s such as the Einasto 
pro file (|Einastol 1965 1 1 as discussed by iNavarro et al.l (|2004l ') 
and iMerritt et aIT ( 2006l l: however, the price to pay for this 
improved accuracy is the introduction of an additional de- 
gree of freedom and its potential correlations with M200 and 
c. 

We point out in passing that we have not imposed any 
relaxation criteria for selecting our simulated clusters and 
select based on mass alone, as it is not trivial to deduce how 
relaxed a real cluster is. It is known that the NFW profile 
does not describe ob viously unrelaxed cluster haloes well 
(e.g.. lNeto et al.ll2007l ) and thus we expect that the accuracy 
of the reconstructed mass and concentration of real systems 
will depend on the dynamical state of the cluster. 



4.1 Quantifying the spread in the masses and 
concentrations 

The results in the previous section underline the need to 
quantify and account for bias and scatter in observationally 
derived cluster masses and concentrations in large surveys. 
For detailed studies of individual clusters the bias may be 
less relevant, but knowing the expected scatter is still impor- 
tant. In this section, we present a quantification of the bias 
and scatter in our mock WL derived masses and concentra- 
tions. As variation with halo mass and resulting strength 
of the lensing signal can be expected, our sample was first 
divided into five (true) mass bins, as indicated in Table Q] 
For each of these five bins, a histogram of the relative masses 
and concentrations, normalised to true mass Mmui and best- 
fit 3D concentration C3D, was then created. The results are 
shown in Fig. [3] 

The spread in both Mwl and cwl is clearly mass- 
dependent and decreases with increasing cluster mass. Over- 
concentrations of more than a factor of 2.5 are virtually non- 
existent except for the lowest mass bin where there is an, 
albeit small, group of cluster projections whose concentra- 
tions are overestimated by up to a factor of 3. The masses are 
somewhat better constrained, over- and underpredictions by 
more than a factor of 2 being rare in all mass bins (apart 
from the very lowest). 

The error distributions in mass and concentration were 
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Figure 3. Spread in WL concentrations cwl/c3D (red, solid line) and masses Mwl /-^Mill (blue, dash-dot line) for different mass 
ranges. Shown is the fraction of projections in each bin. The solid black lines show the corresponding best-fit log-normal distributions 
as described in the text, with parameters given in table [T] The numbers in the figure give the average concentration, mass range and 
number of projections per bin. The scatter in the recovered masses and concentrations decreases with increasing halo mass and closely 
follow log-normal distributions. 
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Table 1. Parameters of the log-normal fit to the distributions of mass and concentration deviations as described in the text. Also given 
are the mean, median and Qo.975 quantile for both distributions. Note that fi and cr, the median and standard deviation in the underlying 
normal distribution, are the location and spread in the log- normal fit as defined in equation 1 141 1 . 



fit with a log-normal distribution 



0.1 



xV2t 



(14) 



where the prefactor of 0.1, equal to the bin size in Fig. O 
converts the probability distribution function into the rel- 
ative histogram density shown in this figure. As shown in 
Fig. [3] the best fit provides an excellent representation of 
the error distributions. The corresponding parameters are 
quoted in Table [1] together with the median and mean ob- 
tained directly from the error distributions. Also given are 



the Qo.975-quantiles, which give the relative error exceeded 
by only 2.5% of projections as an indication for "reasonably" 
likely overconcentrations expected in observations. 

We point out here that, dealing with non-Gaussian dis- 
tributions, the conventional (arithmetic) standard deviation 
is only of limited applicability. For the remainder of this pa- 
per, we will therefore use a for the spread parameter (the 
standard deviation in the underlying normal distribution) 
as defined in equation (|14[) and 'scatter' for the offset from 
unity in the geometric standard deviation, e CT — 1. 

Apart from large scatter, both the concentration and 
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the mass also display a slight bias in the sense that, on aver- 
age, the reconstructed values are slightly lower than the true 
ones. This accounts for the lower-than-expected normalisa- 
tion of the WL-derived mass-concentration relation evident 
in Fig. [2] We aim to provide an explanation for these biases 
in Section below. 

Note that we have chosen to use medians, rather than 
means to quantify bias. The rationale behind this is that, in 
a non-Gaussian distribution as is the case here (log-normal) , 
the mean, unlike the median, depends on the scatter as 
overpredictions can be arbitrarily high, whereas values can 
clearly not be underpredicted by more than 100%. From the 
amount of scatter evident in our results (see Figs. [3] and [5]) 
one should not be surprised to find that the mean mass and 
concentration show, in general, a positive bias with respect 
to their median counterparts. For completeness, we show 
the difference between mean and median bias in Fig. I C 1 1 in 
appendix [C] 



4.2 Comparison to previous work 

4.2.1 Becker & Kravtsov (2011) 

The bias and scatter in cluster masses derived from weak 
lensing were recently studied in detail bv lBecker fe Kravtsov! 
Hon], BK11) using clusters formed in a cosmological simu- 
lation independent of the MS run at somewhat lower reso- 
lution. In this study, the mass derived from WL was found 
to be biased low at a level of ~ — 5%. Considering that 
these authors employed a slightly different reconstruction 
method in which background galaxies were used over a ra- 
dial range from 1' to 20' from the cluster centre and a shear 
profile formed from them, our results are in good quanti- 
tative agreement (see also Fig. IB3I in the appendix, where 
we analyse our simulation using the same radial range as 
BK11). The scatter determined by BK11 (~ 20%) is very 
close to the level we derive (~ 25%); we note, however, that 
these two numbers were derived using two slightly different 
analysis methods. 



4.2.2 Ogurt & Hamana (2011) 

Biases in both mass and c oncen tration have also been stud- 
ied bv lQguri fe Hamanal (l201ll. OH11). who foun d a mass 



bias similar to that in iBecker fe Kravtsov! (|201lh and pre- 
sented here. However, in contrast to our results, they find 
a very large, positive concentration bias of ~ 20%. It is 
presently unclear what the origin of this difference is. We 
speculate that it may originate from a difference in the weak 
lensing simulation method between our two studies: while 
our results are based on direct fitting of a high resolution 
weak lensing simulation, OH11 analyse an analytic circularly 
symmetric shear profile that was derived by stacking (mock) 
ray-traced lensing observations of galaxy clusters formed in a 
low resolution cosmological simulation. The azimuthal aver- 
aging is expected to smooth out the presence of substructure 
and triaxiality, both of which tend to bias the concentration 
low (see 15. 3. 31) . 



5 ORIGIN OF SCATTER AND BIAS 

Having established the extent of the scatter and bias in WL 
reconstructions of cluster haloes, we now aim to find physical 
explanations for them. This is an interesting question in its 
own right, but might also allow an identification of possible 
ways to reduce these systematic errors. 

Any potential error sources can be broadly grouped into 
two categories: Those due to the background galaxies used in 
the reconstruction (i.e., their unknown intrinsic ellipticities 
and finite number, in general also their intrinsic alignment 
due to cosmic shear) , and those due to the cluster itself, such 
as halo triaxiality and substructure. In this section we show 
that, in the case of large statistical samples of clusters such 
as we have studied here and those to be derived from the 
DES and LSST, the latter is dominated by the former only 
for clusters with masses below a few 10 14 M o . 

Our strategy for assessing the importance of these var- 
ious error contributions involves making two additional re- 
constructions of our cluster sample, designed to bridge the 
gap between the WL analysis based on particles within a 10 
h" 1 Mpc box on the one side and the 3D fitting procedure 
within a radius r2oo on the other. In the first of these, which 
we will refer to as "perfect WL" , we use a very high density 
(n = 300 arcmin -2 ) of perfectly circular background galax- 
ies (i.e., a = 0.0), which eliminates the influence of shape 
noise and sampling — essentially, we are now analysing the 
(reduced) shear field g directly. 

In the second method, we approach the 3D fit even fur- 
ther by constructing the convergence field k — and thus the 
shear — only from those particles that lie within a (3D) dis- 
tance of r2oo from the cluster centre, the same set of particles 
upon which the 3D fit is based. We will refer to this method 
as "spherical WL ". One problem with this a pproach is that 
the expression of I Wright fe Brainerdl i|2000l ) for q assumes 
a matter distribution extending to infinity, so fitting it to 
a catalogue of galaxy distortions based only on the matter 
distribution inside r2oo alone, which necessarily contains less 
total mass, will result in severe biases in both mass and con- 
centratiorjj. We overcome this by instead fitting the reduced 
shear fr om an NFW profile tha t is, like our data, trun cated 
at r 20 o (|Takada fc J aid l2003al : ITakada fc Jainl 1200301 ). We 
note that it is straightforward to also fit the projected mass 
profile of ITakada fc Jainl l|2003al ) directly to the projected 
matter within r2oo- This method approaches the 3D fit even 
closer, with the only remaining difference being a fit in 2D 
vs. one in 3D. We have done this, and found that the results 
are in very close agreement with those of the 'spherical WL' 
method. 

The bias and scatter as defined in equation (|14|) in 
masses and concentrations resulting from both these meth- 
ods are shown in Fig. [4] and [5] respectively, the perfect WL 
fit represented by red lines, the spherical WL fit by blue 
ones. For ease of comparison, we also include the values de- 



4 We have explicitly verified that there is no significant difference 
between n = 100 and n = 300 for a = 0.0. 

5 The latter because the influence of the 'missing mass' is greatest 
at large projected radii R where only a short section of the line 
of sight passes through the inner cluster region as illustrated in 
Fig. lAll in appendix [Al 
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Figure 4. Median values of the distributions derived from our 
default WL simulation (n = 30, cr = 0.2, black solid line), "per- 
fect WL" (n = 300, a = 0.0, red dashed line) and "spherical WL" 
(parameters as in perfect WL, but only based on the matter distri- 
bution within r200; blue dash-dot line). See text for details. Top: 
concentration, bottom: mass, also showing the median values in 
M3D obtained from 3D mass profile fitting (green dash-dot-dot- 
dot line). The vertical lines at the bottom show the underlying 
mass bins. 

terminer! from our default WL simulation as found in Table 
[T]as black lines. 

5.1 Influence of background galaxies 

We can judge the influence of errors associated with the 
background galaxies by comparing the "default" and "per- 
fect" WL reconstructions (black and red curves in Figs. [4] 
and[S}, the latter one, as explained above, not being affected 
by them. 

5.1.1 Scatter due to background galaxies 

Focusing first on scatter in default vs. perfect WL (Fig. [5]), 
we find a very similar picture for both mass and concen- 
tration: it is comparable for the highest-mass clusters, but 
while the latter is almost mass-independent, the former in- 
creases considerably with decreasing cluster mass. This is 



Figure 5. As Fig. [4] but instead showing the scatter e a — 1 in 
the best-fit lognormal distribution with a as defined in equation 



what would be expected from the influence of shape noise: 
Less massive haloes, producing a weaker shear signal, yield 
a lower signal-to-noise ratio than their high-mass counter- 
parts; in the total absence of shape noise, however, the de- 
creasing shear signal is irrelevant. 



5.1.2 Bias due to background galaxies 

As with scatter, the variation in bias between default and 
perfect WL is similar for both mass and concentration. In 
both cases, it is generally negative and slightly stronger in 
the case of perfect WL than in the default simulation (with 
the exception of the mass bias for the highest mass clusters): 
~ —9% vs. ~ —5% for concentration and ~ —5% vs. w —3% 
for mass, with no clear trend with halo mass in any of them. 
This might be slightly surprising, given that we would not 
expect a direct bias from the unknown background galaxy 
cllipticities. However, in Section [5.3.31 below, we show that 
substructure tends to produce an overall negative bias. One 
possible explanation of the bias due to background galax- 
ies is therefore that the combination of shape noise and fi- 
nite sampling essentially smoothes out small-scale effects like 
substructure. This indirect bias can, overall, make imper- 
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feet weak lensing observations of very large cluster samples 
slightly less biased than perfect ones. 

5.2 Structure outside r2oo 

We now look at the structure of the clusters themselves, fo- 
cusing first on their outer regions beyond r2oo by comparing 
the "perfect" and "spherical" WL reconstructions (red and 
blue curves in Figs. [4] and [5]) — the only difference between 
them being that the former includes mass beyond r2oo while 
the latter does not. 

5.2.1 Concentration 

For the concentrations, we find a similar scatter from both 
methods (compare the red and blue curves in the top panel 
of Fig. [5]). In fact, the scatter is even slightly larger for the 
spherical analysis, a strong indication that it is driven by 
the mass distribution inside 7-200 as discussed in detail be- 
low. The bias is even stronger for spherical WL than either 
of the other two methods (compare the blue and black/red 
curves in the top panel of Fig. [4}, at a level of « —12% 
largely independent of cluster mass. This implies that ef- 
fects inside r2oo bias the concentration low, whereas those 
outside tend to increase it again, by ss 3%. The overall WL 
concentrations are biased negative, because the influence of 
the former effects dominates. One such effect causing a posi- 
tive bias could be the deviation of the azimuthally averaged 
m ass distribution from an NFW profile as recently shown 
bv lQguri fc Hamanal (|201lD . 

5.2.2 Mass 

Looking at the masses, a somewhat different picture 
emerges: The values reconstructed from the spherical fit 
(blue lines) are considerably more tightly constrained with 
a typical scatter of only ~ 5% and a bias at a level of only 
~ —2%. This becomes even more remarkable when com- 
pared to the spread in the masses obtained from 3D fitting, 
ie. Mso/Mmui, which we show by green lines in Figs. U and 
[5] The very close agreement between these indicates that the 
spherical WL mass reconstruction is as accurate as could be 
hoped for. The negative bias in the 'perfect' and 'default' 
simulations is thus due to the mass distribution outside r2oo- 
As in the case of concentration, a likely explanation for this 
bias is the deviation of the mass distribut ion outside ~ r2oo 
from an NFW profile (see, e.g., Fig. 1 of lHavashi fc White! 
l200ct ). This leads to less mass along the line of sight than 
expected from an NFW profile extending to infinity, which 
expla ins the negative mass bias (see also lOguri fc Hamanal 

Eon]). 

5.3 Deviations from NFW within r2oo: Triaxiality 
and substructure 

We demonstrated above that most of the scatter and bias 
in reconstructed concentrations is due to deviations from a 
spherically symmetric NFW profile within r2oo- The obvious 
culprits responsible for these deviations are asphericity (e.g., 
triaxial haloes) and substructure. We now investigate the 
role played by each of these sources of error. 



To begin with, an overall sense of the validity of the 
(spherically averaged) NFW approximation is given by the 
-M3D /JVf M iii distributions shown in Fig.|3]and[S](green lines). 
With Mjymi being a model-independent quantity, it provides 
a reference value for M3D which can be used as an indica- 
tion of how well the NFW profile describes a cluster. The 
(logarithmic) scatter and bias are both small at a level of 
ss 5% and « —2% respectively. This confirms that, despite 
the obvious presence of substructure and the overall triaxial- 
ity of the simulated clusters (see, e.g., Fig. [I}, the spherically 
averaged density is still well-described by the NFW profile. 

But while the 3D mass structure of the haloes may be 
relatively well described by an NFW profile for many clus- 
ters, the lensing deflection depends on (the gradient of) the 
projected density. For realistic, non-spherically-symmetric 
cluster haloes, deviations from symmetry can be expected to 
affect 3D and 2D reconstructions differently, so it is entirely 
plausible that the shear signal for a cluster, even one that is 
well represented by an NFW profile in 3D, may not be well 
described by a 2D profile derived from it. 

5.3.1 Halo triaxiality 

We fir st look at the effect of halo triaxiality. Ijing fc Sutol 
I2002T ) suggest a triaxial generalisation of the spherical NFW 
profile by replacing the radius r in @ by r e g where 

V"2 ^2 

rl« = — + Y 2 + — (15) 
a z b A 

where X, Y and Z are the distances along the major, inter- 
mediate and minor axes respectively; the numbers a and b 
are the ratio of the major and minor axis to the intermediate 
axis, respectively. 

In a similar way to our standard 3D fitting procedure 
described above, we now also fit this triaxial NFW profile 
to our lensing haloes. Each halo is first subdivided into five 
concentric shells covering a radial range from -1.5 to in 
log 10 (r/r2oo). Each shell is further divided into 24 2 sectors 
of equal volume. Overall, this procedure divides the cluster 
into 2880 cells, for each of which we compute the average 
density pi. The triaxial NFW profile is then fit by least- 
squares regressiorjf). 

Applying this to the question of the influence of halo 
triaxiality on lensing reconstructions, we show, in the first 
panel of Fig. [6] how the angle 8 between the line of sight 
and the major halo axis correlates with over- and under- 
prediction of the lensing cluster's mass and concentration. 
Each point corresponds to a mock WL reconstruction of a 
simulated cluster; we include all simulated clusters with 5 
projections each. It is immediately obvious that projections 
with small S lead to overpredictions in both mass and con- 
centration, the opposite being true for cases with S ~ 90°. 
The role of orientation becomes even more obvious when 
we move to the spherical WL fit described above and only 
analyse the region inside r2oo, as shown in the second panel 

6 We have also tried computing the a xis ratios by diag onalising 
the moment-of-inertia tensor (see e.g.. lShaw et al]|2006fl . In gen- 
eral the two methods produce results in the same sense (i.e., both 
favour "prolate-like" distributions), with the moment-of-incrtia 
method generally yielding slightly smaller axis ratios than found 
from our default method. 
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Figure 6. Reconstructed masses and concentrations, both normalised to "true" values (Mym\ and C313 respectively). The values in the 
left-most panel are derived from our default WL analysis, in the other three from the spherical WL reconstruction based only on the 
matter distribution inside r2oo- Note that the horizontal axes are scaled differently to account for the much smaller mass scatter in the 
latter reconstruction. The colour shows, from left to right, the angle between the major halo axis and line of sight (first two panels), the 
ratio between major and minor halo axis (third panel) and the fraction of the halo mass in bound substructures within r200 (last panel). 
The influence of halo orientation is clearly dominating the scatter. 



in Fig. HJ] This reduces the scatter along the (1,-1) direc- 
tion considerably, identifying the influence of background 
galaxies on low-mass clusters as its main cause. The finding 
that decreasing 8 increases cwl and Mwl of individual clus- 
ters simultaneously c onfirms previous work on the eff ect of 
cluster triaxiality by IClowe. De Lucia fe Ki ng ( 2004) , who 
analysed a sample of four massive haloes and found a strong 
correlation between co ncentration and halo orientation, and 
ICorless fc Kingl (|2007l) who derived a similar result using 
analytic cluster haloes. The latter authors concluded that 
triaxiality could cause overpredictions in concentration by 
a factor of 2, in good agreement with the second panel of 
Fig. [5] The scatter in masses — deviations up to a factor 
of 1.5 — reported by these authors, on the other hand, is 
considerably larger than ours (~ 1.1). This may be due to 
the best-fit NFW mass being influenced most severely by 
matter in the c luster outskirts a s disc ussed above. The an- 
alytic model of ICorless fc Kind (|2007T I includes this matter 
beyond r2oo whereas our spherical WL analysis does not. 

Note that in the first two panels of Fig. [6]the magnitude 
of the ratio between major and minor axis was not taken into 
account at all. We explore its influence in the third panel of 
Fig. [6] and find a much weaker correlation than with halo 
orientation. Haloes with extremely high axis ratios have a 
tendency to lead to more over- or underpredicted masses and 
concentrations, as should be expected, but the influence is 
clearly much smaller than that of orientation. 

We noted above that the concentration scatter decreases 
slightly upon inclusion of matter outside r2oo- One possible 
explanation for this effect is that matter beyond r2oo, while 
still correlated to some extent with the cluster major axis, 
is mo re randomly distributed (see also iBecker fc Kravtsovl 
120111 ) and therefore reduces the impact of the triaxiality- 
induced concentration scatter a bit. 



5. 3. 2 Substructure 

While we have just demonstrated a strong influence of halo 
triaxiality on reconstructed NFW parameters of individual 
clusters, there remains some scatter which is not correlated 
with this. In the right-most panel of Fig. [5] we therefore 
investigate the influence of substructure, quantified as the 
fraction /s u b of the halo mass which is found in bound 
subhaloes within r2o o identified by the Subfind algorithm 
jSpringel et al.ll200ll ). This fraction is generally small with 
only 15% of haloes having /s u b > 0.1. The plot shows some 
influence on the reconstructions, most notably on concentra- 
tion, which tends to be underpredicted in high-substructure 
clusters. However, as with the axis ratio, the influence is 
much less strong than that of cluster orientation. 



5.3.3 Origin of concentration bias 

We have shown above that the scatter in concentration can 
be ascribed largely to the influence of halo orientation. How- 
ever, for a large sample of clusters, oriented randomly to- 
wards the observer, this leads to overestimation of concen- 
tration in some haloes, and underestimation in others (see 
Fig. O . While this does not necessarily eliminate all influ- 
ence of triaxiality on the concentration bias even for arbi- 
trarily large cluster samples, it can be expected to reduced 
it to a level where the effect of substructure becomes non- 
negligible. We explore the role of both effects in this context 
in Fig. [7] For this, the sample is split into five equally large 
quintiles, once in order of increasing axis ratio, and once by 
substructure fraction. For each of the 25 resulting combina- 
tions, the median concentration, normalised to C3D, is then 
formed. In this way, the figure shows both the variation with 
axis ratio at (nearly) fixed substructure level and vice versa 
and can therefore eliminate potential correlations between 
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Figure 7. Influence of substructure fraction (different colour 
lines) and triaxiality (x-axis) on concentration bias (y-axis). It is 
evident that higher substructure and higher triaxiality both lead 
to lower concentrations, but the effect of substructure is stronger. 

these two effects. For added clarity, the black line shows the 
concentration bias when the sample is split only according 
to axis ratio. 

There are two clear trends in this figure: A decrease in 
concentration from left to right, corresponding to an increase 
in axis ratio (of « 5% in the case of the lowest substructure 
quintile) , and from blue to red, as the substructure fraction 
increases (of ~ 10% for the least elongated clusters). Both 
triaxiality and substructure therefore tend to lower the con- 
centration, but the influence of substructure appears to be 
dominant. 

While the addition of substructure to the outer parts 
of a smooth NFW halo can be expected to reduce the best- 
fit concentration of both 2D and 3D analyses, its influence 
appears to be larger in 2D. This might be due to the low 
surface mass density in the projected outer cluster regions 
(see Fig. lAlf l . which is affected more severely by the presence 
of substructure than the mass profile obtained in 3D. 

5.4 Summary of this section 

To summarise the results and interpretations of this section: 
Within r2oo, substructure and triaxiality cause a negative 
bias (~ —12%) and strong scatter in WL concentration, but 
leave the reconstructed mass largely unaffected. Structure 
outside r2oo, the "correlated large-scale structure", biases 
concentration positively and mass negatively, due to devia- 
tions of the mass profile from the NFW model at these large 
radii. The scatter in mass is strongly increased by matter in 
this region, but the orient at ion- induced scatter in concen- 
tration is, to a small degree, cancelled out by it. Imperfect 
weak lensing observations smooth out part of the influence 
of substructure and therefore cause a slight improvement 
in the mass and concentration bias. Shape noise, while not 
solely responsible for the mass and concentration scatter, 



contributes considerably to it, in particular for lower mass 
clusters. 



6 DISCUSSION AND CONCLUSIONS 

We have analysed a large set of mock WL observations of 
galaxy clusters at redshift zl — 0.2 extracted from the Mil- 
lennium Simulation (MS) using background galaxies with 
elliptical isophotes at uniform redshift zs = 1.0. The aim 
of our work was to quantify the expected scatter and bias 
in the reconstructions of masses and concentrations of large 
cluster samples derived from WL surveys such as DES and 
LSST. We focus on the effect of the matter within and 
close to the lensing clusters, explicitly ignoring the effect 
of uncorrelated larg e-scale structure (as studied, e.g., by 
Irloekstra et aljfeoill . see below). Furthermore, as we are in- 
terested in the bias and scatter induced by the clusters and 
the weak lensing method itself, we have explicitly ignored 
any additional observational sources of error, such as diffi- 
culties in measuring the background galaxy ellipticities and 
redshifts. Nevertheless, from the analysis of these mock ob- 
servations, and subsequent comparison with the true cluster 
parameters, we can draw the following conclusions: 

• We confirm that the dark matter haloes in our sample, 
although not selected using any relaxation criteria, are well- 
described by the NFW profile. The NFW masses M^d agree 
to within ~ 5 % (la) with the true halo masses. 

• The mass-concentration relation derived from our mock 
observations has a normalisation of a = (4.25 ± 0.04) and 
slope /3 — (—0.10 ± 0.01). The corresponding values for the 
'true' mass-concentration relation of our sample are a^o — 
(5.02 ± 0.08) and (3 3 d = (-0.16 ± 0.02). Both the slope and 
normalisation of the weak lensing derived relation are too 
low compared to their 3D counterparts. 

• The spread in the WL parameters Mwl/Mmm and 
cwl/c3d closely follows a log-normal distribution. Its scat- 
ter decreases with increasing halo mass, due to an increased 
strength of the lensing signal (for concentration from 0.57 to 
0.29, and for mass from 0.36 to 0.21 between clusters with 
M200 < 10 141 A/ Q and M200 > 1O 14 - 8 M respectively). Both 
mass and concentration show in general a negative median 
bias at a level of « —3% and ~ —5% respectively. Due to 
the presence of scatter, the mean mass and concentration 
are generally higher than their median counterparts. 

• While shape noise due to the unknown intrinsic orien- 
tation of background galaxies is an important contribution 
to the parameter scatter (particularly for lower mass haloes 
with M200 ~ 10 14 Mq), we find that physical properties of 
the clusters themselves (e.g., triaxiality, substructure, corre- 
lated line-of-sight matter) also contribute significantly and 
are the dominant source of scatter for haloes with masses 
of M200 ~ 10 15 M©. Triaxiality of the cluster halo within 
?~200, is the main contributor to the scatter in concentra- 
tions, alignment between major halo axis and the line-of 
sight being the dominant factor. The concentration bias is 
dominated by substructure within the cluster. The bias and 
scatter in the recovered mass is affected mostly by matter 
beyond r2oo, i.e., correlated large-scale structure where de- 
viations from the NFW profile may be important. 
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We note that this comparison between WL-derived and 
'true' 3D-derived concentrations is somewhat sensitive to 
the radia l fitting ranee us ed in determining the latter; as 
found by iGao et ah! (|2008l ) , a larger fitting range probing 
regions closer to the cluster centre tends to increase the best- 
fit concentration. In this work, we have used the smallest 
possible truncation radius allowed by the resolution of the 
simulation and the mass range of our clusters (0.02 r2oo)- 
For an accurate calibration of the bias and scatter expected 
from a particular survey, it is therefore not only important 
to accurately model the survey, but also the way in which 
the theoretical comparison data is derived. At the price of 
introdu cing a third fitting parameter, use of the Einasto 
profile (|Einastolll965h may be a possible way to remove this 
dependence on the radial fitting range. 

Our analysis of the physical origin of scatter and bias 
suggests that the most promising way to reduce the uncer- 
tainty in concentration measuremen ts from WL is to emplo y 
triaxial halo models as suggested bv lCorless fc Kind (|200Sf ). 
It is however important to keep in mind that not only the 
analysis of observational data, but also the theoretical pre- 
dictions used for comparison need to use this triaxial model 
because the halo 'mass' and 'concentration' in a triaxial 
model will in general be different from their counterparts 
derived using spherical averaging. 

As stated above, in the present study we have not in- 
cluded the influence of uncorrelated large-scale structure at 
large distanc es from the cluster. Using spherical analytic 
NFW haloes. iHoekstra et al.l(|201ll ) have recently studied its 
effect on the recovered masses and concentrations and their 
correlation. They found a small bias in the slope of the recov- 
ered mass-concentration relation, in the sense that the re- 
covered relation is slightly steeper than the true underlying 
one. Additionally, their study addresses the influence of un- 
correlated large-scale structure on the scatter in both mass 
and concentration: for a cluster of mass M200 = 1O 1j M0 this 
is comparable to the effect of shape noise and can therefore 
be expected to contribute significantly to the overall error 
budget, in particular for surveys extending to lower-mass 
clusters. A combined study, taking into account both uncor- 
related and correlated error sources using realistic clusters 
would be a valuable way to make even more realistic pre- 
dictions of the expected bias and scatter in WL parameter 
reconstructions. 

Another potentially important factor that should be 
explored in future realistic mock weak lensing surveys is 
that of realistic cluster selection. In the present study, we 
have imposed a simple (true) halo mass cut to establish first 
whether or not the recovered masses and concentrations are 
biased, which they are, for an underlying sample that is 
unbiased. Cluster selection itself (e.g., based on optical rich- 
ness, Sunyaev-Zel'dovich effect flux, X-ray luminosity, weak 
lensing shear signal), however, can potentially introduce bi- 
ases which may be larger than those we have studied here 
and therefore it is important that these potential biases be 
quantified in the future. 

While our quantification of scatter and bias in weak 
lensing measurements was motivated by the use of the mass- 
concentration relationship to constrain cosmological param- 
eters, our results can also be applied to outliers in observed 
concentration. For instance, we have shown that those clus- 
ters which are elongated along the line of sight are most 



liable to having their concentration overestimated in weak 
lensing studies. We can also make predictions for how many 
clusters we would expect to exceed a particular concen- 
tration. For high-mass system with M200 > 1O 14 ' 8 M0, for 
which the Millennium Simulation includes no systems above 
C3D = 5.7, we find that 7% of cluster projections yield weak 
lensing-derived concentrations of cwl > 6, and only 1% ex- 
ceed cwl = 8. We re-iterate at this point that our study has 
not taken into account uncorrelated line-of-sight structure, 
which might increase these fractions somewhat. 

As long as bias and scatter are properly accounted for, 
future WL surveys are expected to accurately determine the 
mass-concentration relationship of galaxy clusters, even with 
modest numbers of background galaxies per cluster. The 
form of the mass-concentration relationship, and its evolu- 
tion with redshift, provide a sensitive probe of the growth 
of structure and therefore offer an important new and inde- 
pendent method of testing our cosmological paradigm. 
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APPENDIX A: TRUNCATED NFW PROFILE 

The NFW profile truncated at some limiting (3 D) radius 
rum (|Takada fc Jainll2003al . iTakada fc J ain 2003bJ) is 



(r/r s )(l + r/r s ) 2 



6(nim - r) 



(Al) 



where O is the Heaviside Unit Step function and p s and r s 
the scale density and length as defined in section [3~3l 

The projected mass density of this profile integrated 
along the line of sight is then given by 



E(R) = 2p s r s 



R Vr 2 - R 2 (l + r/r a ) 



: dr (A2) 



where R is the distance from the cluster centre perpendicular 
to the line of sight. 

Evaluating this integral yields 



E = 2S c p c r a S 

where S depends on the value of x — r/r s 
For x < 1: 



(A3) 



S = 



o:(r s + nim ) \ _ % /(l-a: 2 )(r 1 2 im ~r|3: 2 ) 

r lila + r s x 2 -y/(l-x 2 )(r 2 ni -r 2 x 2 ) J r >+ r lim 



For x = 1: 

For x > 1: 
— arctan 



S = 



{l-x 2 f 2 



(nim - r s )(2r s + Him) 
3(r s +r Um )y / r? im -r 2 



(A4) 
(A5) 



7 lim~l" r s x 



(x 2 - l) 3 / 2 



(A6) 



APPENDIX B: EFFECT OF VARIATIONS IN 
LENSING SIMULATION 

Bl Line-of-sight integration length 

The effect of increasing the line-of-sight integration length 
from our default value of Wh^ 1 Mpc by a factor of 5 to 
50h~ Mpc is explored in Fig. IB1I We find very little varia- 
tion between the two lengt hs, consistent with the findings by 
iBecker fc Kravtsovl (|201li ). Our default integration length of 
10/i -1 Mpc is therefore sufficiently large to capture the in- 
fluence of correlated large-scale structure close to the lensing 
cluster. 
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Figure Al. Surface density of an NFW profile integrated along 
the line of sight. The solid black line corresponds to an untrun- 
cated infinite profile, whereas the blue dashed and red dash-dot 
lines show profiles truncated at 2 T2oo an d r 200 respectively. Trun- 
cation mostly affects the surface density in the outer cluster re- 
gions beyond ~ 0.5ri; m . 

B2 Background galaxy ellipticity 

In Fig. lB2l we investigate the effect of increasing the value of 
the background galaxy ellipticity dispersion from our default 
of 0.2 to 0.3 and 0.4 per component as well as decreasing it 
to zero. As can be expected, the scatter in both mass and 
concentration increases with increased shape noise. There is 
also a very small influence on the mass and concentration 
bias, in the sense that a higher ellipticity dispersion leads 
to higher bias. As discussed in section 15.1,21 this is most 
likely due to the fact that shape noise, in combination with 
finite sampling, smoothes out the influence of triaxiality and 
substructure, which both tend to cause a negative bias. 

B3 Weak lensing survey range 

Finally, we show in Fig. IB3I the effect of varying the ra- 
dial survey range from our default of 30" to 15'. The biases 
and mass scatter are only affected at a level of a few per- 
cent. The concentration scatter is somewhat more sensitive, 
particularly on the choice of inner cut-off radius: increas- 
ing this to 1' causes a scatter increase by « 30% for the 
lowest-mass clusters. In general, the concentration appears 
to be more sensitive to the value of the inner than the outer 
cut-off radius, t he opposite being true for mass. For ease of 
comparison with lBecker fc Kravtsovl (|201ll ). we also include 
an analysis covering the radial range used in their study, in 
which we form a shear profile from 15 bins spaced logarith- 
mically between 1' and 20' which is then fit to the NFW 
model. There is hardly any difference between the results 
from this fit and our default method in which we use each 
tangential galaxy ellipticity individually. 
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Figure Cl. Difference between bias definition as median (our 
default, thick lines) or mean (thin lines) on concentration (top) 
and mass (bottom). The mean shows, in general, a clear positive 
bias. 

APPENDIX C: VARIATION IN BIAS 
DEFINITION 

In Fig. IC1I the difference between defining bias as the me- 
dian or mean is shown. While both are identical in the case 
of a Gaussian (normal) distribution, this is not generally the 
case for a log-normal parameterisation as employed here (see 
Fig. [3}. In terms of the parameters and a as defined in 
equation (|14[) . the median is given by 

x = e M (Cl) 

and the mean by 

< x >= e" +CT2/2 . (C2) 

Thus, while the median depends only on fj,, the mean is ad- 
ditionally sensitive to the scatter a. This is confirmed by 
Fig. IC1I Distributions with large scatter like concentration 
in our default analysis (black lines, top panel), have a mean 
up to ~ 20% higher than the median. For the very well con- 
strained spherical WL mass distribution (blue lines, lower 
panel), on the other hand, mean and median are virtually 
identical. 



16 



Y.M. Bahe et al. 



Concentration 



lass 



0.25 
^ 0.20 
A 0.15 

CO 

o 0.10 
0.05 

ir 

0.00 






.0 0.5 1.0 1.5 2.0 2.5 3.0 



0.25 
0.20 
0.1 5 

0.10 

0.05 

0.00 






10 Mpc/h : 

50 Mpc/h : 


A 





.0 0.5 1.0 1.5 2.0 2.5 3.0 



Concentration 



ass 




10 Mpc/h 
50 Mpc/h 



.0 0.5 1.0 1.5 2.0 2.5 3.0 




0.5 1.0 1.5 2.0 2.5 3.0 



Figure Bl. Effect of increasing the line-of-sight integration length to 50 h^ 1 Mpc, shown by solid lines, compared to our default choice 
of 10 h^ 1 Mpc (broken lines) on concentrations (left) and masses (right). There is very little variation, neither for high-mass systems 
with M200 > 10 14 ' 8 Mq (top), nor for low-mass systems with M200 < W Mq (bottom). 
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Figure B2. Effect of increasing the dispersion in the intrinsic ellipticities of the background galaxies from our default value of 0.2 per 
component (black, solid line) to 0.3 (red, dashed line) and 0.4 (blue, dot-dashed line) per component respectively. The top two panels 
show the effect on the concentrations, the bottom two on the masses. In both cases medians are shown on the left and scatter on the 
right; note the different ordinate scalings for the mass and concentration scatter plots. Increased shape noise causes a small positive bias, 
due to smoothing out of substructure and triaxiality, and a strong increase in scatter. 
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Figure B3. Effect of varying the inner and outer cutoff radius (r- ln and r ou t respectively); note the different ordinate scalings for the 
mass and concentration scatter plots. Varying n n influences mostly the concentrations, whereas the masses are more sensitive to the 
value of r ou t. For the first three analyses (black solid, red dashed and blue dash-dot lines), we use our default method of using each galaxy 
cllipticity individually, whereas the last one (purple dash-dot-dot-dot lines, 1' - 20') uses 15 logarithmically spaced bins to reproduce the 
analysis setup of BK11. There is no indication for significant differences between these two methods. 
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